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CLAIMS 



[Claim(s)] 

[Claim 1] Between the second apparatus that receives the second data transmitted from the first apparatus that 
transmits the second data that should reproduce the first data, and should be synchronized and reproduced via a 
channel, and said first apparatus, and is reproduced. Are reproduction timing of said first and the second data the 
synchronous reproduction method for making it synchronize, and transmission of said second data, Inside of two or 
more reference points defined on a time-axis at a meaning with a time interval which added the predetermined 
transmission start possible section to maximum delay time after transmitting said second data until it becomes 
refreshable by a receiver, A synchronous reproduction method starting within the transmission start possible 
section which begins from one of reference points, and starting reproduction of said first and the second data based 
on a reference point of the beginning after the transmission start possible section which started transmission of said 
second data. 

[Claim 2]A synchronous reproduction method according to claim 1 performing synchronous processing which 
synchronizes a clock by which said first and the second apparatus serve as a time reference of a time-axis which 
defines said reference point, respectively between said first apparatus and said second apparatus before starting 
transmission of said second data. 

[Claim 3]A synchronous reproduction method according to claim 1 , wherein said first data is a video data and said 
second data is voice data. 

[Claim 4]A synchronous reproduction method according to claim 1 , wherein said first data is voice data and said 
second data is a video data. 

[Claim 5]A synchronous reproduction method according to claim 1 starting reproduction of said first and the second 
data when time beforehand set from a reference point of the beginning after the transmission start possible section 
which started transmission of said second data passes. 

[Claim 6]A synchronous reproduction method according to claim 1 , wherein said channel is a radio channel. 
[Claim 7]Between the second apparatus that answers a reproduction start command transmitted from the first 
apparatus that transmits a reproduction start command which directs a reproduction start of the second data that 
should reproduce the first data, and should be synchronized and reproduced via a channel, and said first apparatus, 
and reproduces said second data, Are reproduction timing of said first and the second data the synchronous 
reproduction method for making it synchronize, and transmission of said reproduction start command, Inside of two 
or more reference points defined on a time-axis at a meaning with a time interval which added the predetermined 
transmission start possible section to maximum delay time until a start of regeneration which answered said 
reproduction start command by a receiver after transmitting said reproduction start command is attained, A 
synchronous reproduction method starting within the transmission start possible section which begins from one of 
reference points, and starting reproduction of said first and the second data based on a reference point of the 
beginning after the transmission start possible section which started transmission of said reproduction start 
command. 

[Claim 8]A synchronous reproduction method according to claim 7 characterized by starting transmission of said 
second data from said first apparatus to said second apparatus via said channel before starting transmission of said 
reproduction start command. 

[Claim 9]A synchronous reproduction system containing the second apparatus that receives the second data 
transmitted from the first apparatus characterized by comprising the following that transmits the second data that 
should reproduce the first data, and should be synchronized and reproduced via a channel, and said first apparatus, 
and is reproduced. 

Inside of two or more reference points defined on a time-axis at a meaning with a time interval which added the 
predetermined transmission start possible section to maximum delay time after said first apparatus transmits said 
second data until it becomes refreshable by a receiver, A means to start transmission of said second data within the 
transmission start possible section which begins from one of reference points. 

A means by which a means to start reproduction of said first data is provided based on a reference point of the 
beginning after the transmission start possible section which started transmission of said second data, and said 2nd 
apparatus receives said second data. 

A means to manage said two or more reference points defined on a time-axis with said time interval at a meaning, 
and to start reproduction of said second data based on a reference point of the beginning of the back [ said second 
received data ] which can be reproduction started. 
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[Claim 10]. Are characterized by comprising the following. A synchronous reproduction system containing the 
second apparatus that answers a reproduction start command transmitted from the first apparatus that transmits a 
reproduction start command which directs a reproduction start of the second data that should reproduce the first 
data, and should be synchronized and reproduced via a channel, and said first apparatus, and reproduces said 
second data. 

Inside of two or more reference points defined on a time-axis at a meaning with a time interval which added the 
predetermined transmission start possible section to maximum delay time until a start of regeneration which 
answered said reproduction start command by a receiver after said first apparatus transmitted said reproduction 
start command is attained, A means to start transmission of said reproduction start command within the 
transmission start possible section which begins from one of reference points. 

A means by which a means to start reproduction of said first data is provided based on a reference point of the 
beginning after the transmission start possible section which started transmission of said reproduction start 
command, and said second apparatus receives said reproduction start command. 

A means to start reproduction of said second data based on a reference point of the beginning after managing said 
two or more reference points defined on a time-axis with said time interval at a meaning, answering said 
reproduction start command and attaining a start of regeneration. 

[Claim 11]Playback equipment in which a receiver can transmit to a device the second data characterized by 
comprising the following that should reproduce the first data, and should be synchronized and reproduced via a 
channel. 

A means to start transmission of said second data within the transmission start possible section which begins from 
one of reference points among two or more reference points defined on a time-axis at a meaning with a time 
interval which added the predetermined transmission start possible section to maximum delay time after 
transmitting said second data until it becomes refreshable by a receiver. 

A means to start reproduction of said first data based on a reference point of the beginning after the transmission 
start possible section which started transmission of said second data. 

[Claim 12]Playback equipment which receives the second data transmitted via a channel from a transmitting side 
device which reproduces the first data, and is reproduced, comprising: 

Inside of two or more reference points defined on a time-axis at a meaning with a time interval which added the 
predetermined transmission start possible section to maximum delay time after transmitting said second data until it 
becomes refreshable by a receiver, A means to receive said second data in which transmission was started by said 
transmitting side device within the transmission start possible section which begins from one of reference points. 
A means to manage said two or more reference points defined on a time-axis with said time interval at a meaning, 
and to start reproduction of said second data based on a reference point of the beginning of the back [ said second 
received data ] which can be reproduction started. 

[Claim 13]Playback equipment in which a receiver can transmit to a device a reproduction start command which 
directs a reproduction start of the second data that should reproduce the first data, and should be synchronized and 
reproduced characterized by comprising the following via a channel. 

Inside of two or more reference points defined on a time-axis at a meaning with a time interval which added the 
predetermined transmission start possible section to maximum delay time until a start of regeneration which 
answered said reproduction start command by a receiver after transmitting said reproduction start command is 
attained, A means to start transmission of said reproduction start command within the transmission start possible 
section which begins from one of reference points. 

A means to start reproduction of said first data based on a reference point of the beginning after the transmission 
start possible section which started transmission of said reproduction start command. 

[Claim 14]Playback equipment which reproduces the second data that should answer a reproduction start command 
transmitted via a channel from a transmitting side device which reproduces the first data, and should be reproduced 
synchronizing with said first data, comprising: 

Inside of two or more reference points defined on a time-axis at a meaning with a time interval which added the 
predetermined transmission start possible section to maximum delay time until a start of regeneration which 
answered said reproduction start command by a receiver after transmitting said reproduction start command is 
attained, A means to receive said reproduction start command with which said transmitting side device started 
transmission within the transmission start possible section which begins from one of reference points. 
A means to start reproduction of said second data based on a reference point of the beginning after managing said 
two or more reference points defined on a time-axis with said time interval at a meaning, answering said 
reproduction start command and attaining a start of regeneration. 

[Claim 1 5]A computer program which makes the second data that should make a computer reproduce the first data 
and should be reproduced synchronizing with said first data transmit to a device of a receiver via a channel, 
comprising: 

Inside of two or more reference points defined on a time-axis at a meaning with a time interval which added the 
predetermined transmission start possible section to maximum delay time after transmitting said second data until it 
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becomes refreshable by a receiver. A procedure of making said computer starting transmission of said second data 
within the transmission start possible section which begins from one of reference points. 

A means to make said computer start reproduction of said first data based on a reference point of the beginning 
after the transmission start possible section which started transmission of said second data. 

[Claim 1 6]A computer program which makes a computer reproduce the second data transmitted via a channel from 
a transmitting side device which reproduces the first data, comprising: 

Inside of two or more reference points defined on a time-axis at a meaning with a time interval which added the 
predetermined transmission start possible section to maximum delay time after transmitting said second data until it 
becomes refreshable by a receiver, A procedure of making said computer receiving said second data in which 
transmission was started by said transmitting side device within the transmission start possible section which begins 
from one of reference points. 

A procedure of making said computer managing said two or more reference points defined on a time-axis with said 
time interval at a meaning, and making said computer starting reproduction of said second data based on a 
reference point of the beginning of the back [ said second received data ] which can be reproduction started. 

[Claim 17]A computer program which makes a reproduction start command which directs a reproduction start of the 
second data that should make a computer reproduce the first data and should be reproduced synchronizing with 
said first data transmit to a device of a receiver via a channel, comprising: 

Inside of two or more reference points defined on a time-axis at a meaning with a time interval which added the 
predetermined transmission start possible section to maximum delay time until a start of regeneration which 
answered said reproduction start command by a receiver after transmitting said reproduction start command is 
attained, A procedure of making said computer starting transmission of said reproduction start command within the 
transmission start possible section which begins from one of reference points. 

A procedure of making said computer starting reproduction of said first data based on a reference point of the 
beginning after the transmission start possible section which started transmission of said reproduction start 
command. 

[Claim 1 8]A computer program which reproduces the second data that should answer a reproduction start command 
transmitted via a channel from a transmitting side device which reproduces the first data, and should be reproduced 
to a computer synchronizing with said first data, comprising: 

Inside of two or more reference points defined on a time-axis at a meaning with a time interval which added the 
predetermined transmission start possible section to maximum delay time until a start of regeneration which 
answered said reproduction start command by a receiver after transmitting said reproduction start command is 
attained, A procedure of making said computer receiving said reproduction start command with which said 
transmitting side device started transmission within the transmission start possible section which begins from one of 
reference points. 

A procedure of making said computer starting reproduction of said second data based on a reference point of the 
beginning after making said computer managing said two or more reference points defined on a time-axis with said 
time interval at a meaning, answering said reproduction start command and attaining a start of regeneration. 



[Translation done.] 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention relates to the method and device for reproducing especially the first and the 
second data synchronously by mutually different apparatus about the method and device for reproducing the first 
and the second data which need to synchronize like a video data and voice data and need to be reproduced. 
[0002] 

[Description of the Prior Art]As a method of making a video data and stream data like voice data processing at the 
time which transmitted to receiver apparatus and was beforehand set from transmitting side apparatus, For example, 
the time information which should be processed by the data to transmit so that the technique indicated by JP,1 1- 
31 7748, A may see is added, it transmits, and the method of waiting for arrival of the time which is contained in the 
received data and which should be processed, and processing data is known for the receiver. 
[0003] 

[Problem(s) to be Solved by the Invention]However, by the above-mentioned technique, the time stamp in which the 
time which should process data is shown needed to be transmitted besides data. For this reason, in accordance with 
the procedure and data format which transmit data, the procedure and form which transmit it also about the time 
stamp in which the time which should process data is shown need to be defined. Therefore, when the protocol as 
which these are not determined was used, there was a problem of being inapplicable. 

[0004]An object of this invention is to provide the method and device which can be synchronously reproduced by 
apparatus which is different in the information which synchronized mutually like [ without having been made in 
consideration of the above-mentioned situation, and transmitting the information about regeneration time ] an 
animation and the sound which accompanies it 
[0005] 

[Means for Solving the Problem]In order to solve an above-mentioned technical problem, this invention between the 
second apparatus that receives the second data transmitted from the first apparatus that transmits the second 
data that should reproduce the first data, and should be synchronized and reproduced via a channel, and said first 
apparatus, and is reproduced, Are reproduction timing of said first and the second data the synchronous 
reproduction method for making it synchronize, and transmission of said second data, Inside of two or more 
reference points defined on a time-axis at a meaning with a time interval which added the predetermined 
transmission start possible section to maximum delay time after transmitting said second data until it becomes 
refreshable by a receiver, It starts within the transmission start possible section which begins from one of reference 
points, and reproduction of said first and the second data is started based on a reference point of the beginning 
after the transmission start possible section which started transmission of said second data. 

[0006]Thus, two or more reference points are beforehand defined on a time-axis with a time interval which added 
the predetermined transmission start possible section to maximum delay time, By starting transmission of the 
second data within the transmission start possible section which begins from a reference point of either of the 
reference points of these plurality, it can guarantee that the second data becomes refreshable by a receiver before 
the following reference point. Therefore, it becomes possible to reproduce synchronously by apparatus which is 
different in information which synchronized mutually like [ without transmitting information about regeneration time 
in any way ] an animation and a sound which accompanies it only by the transmitting side and a receiver setting 
time of two or more reference points of each under the same rule defined beforehand. 
[0007] 

[Embodiment of the Invention] Hereafter, an embodiment of the invention is described with reference to drawings. 
The synchronous reproduction system concerning one embodiment of this invention is shown in drawing 1 . This 
synchronous reproduction system is a system which reproduces the video data in which the sound accompanied, 
and as shown in drawing 1 , it comprises two sets of apparatus. The first apparatus (transmitting side apparatus) 1 1 
is provided with the memory storage with which the voice data which accompanies a video data and it is recorded, 
and it transmits voice data to the second apparatus (receiver apparatus) 14 via the channel 13 at the same time it 
reproduces a video data and reproduces on a display. This first apparatus 1 1 comprises electronic equipment, such 
as a Personal Digital Assistant, a video player, and a personal computer. On the other hand, the second apparatus 
14 is provided with the mechanism which reproduces the receive section of voice data, and the received voice data, 
and reproduces the voice data received from the first apparatus 11. Although this second apparatus 14 as well as 
the first apparatus 1 1 is realizable as various electronic equipment, as that typical example, they are headphone. 
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[0008]By carrying out wireless connection of the apparatus which displays the animation by using the radio channel 
as the channel 1 3 in this system, for example, using Bluetooth (short-range-radio method using an ISM band 2.4 
GHz), and the apparatus which performs audio reproduction, The useful viewing system is realized. 
[0009]Here t I think that he would like to realize what is called lip sync (lipsync) by synchronizing presentation of the 
video data reproduced by the first apparatus 1 1 . and the pronunciation of the voice data reproduced by the second 
apparatus 14. 

[0010] Next, a technical component required in order to realize the above-mentioned demand is explained. When a 
video data and the voice data which accompanies it incorporate them as digital data, saving a mutual time relation 
has already been performed. For example, in the AVI form (Audio Video Interleave Format) of being used as a form 
of the video data with a sound on a personal computer. It is a mechanism in which the reproduction start time of 
each media which the sampling rate is recorded and are recorded is in agreement for every media of an animation 
and a sound. For this reason, it is the structure which can maintain the lip sync (lip sync) by starting each 
reproduction simultaneously and deciding the reproduction speed of each media according to a single clock or the 
clock which synchronized correctly, and a sampling rate. 

[001 1]RTP used by streaming transmission on the Internet as other methods of synchronizing reproduction of two 
or more media (method for transmitting and receiving the media data of an animation, a sound, etc. on Real time 
Transfer Protocol and the Internet.) it is standardized in the RFC1889 grade of IETF, it sees — as — a group — a 
time stamp is given for every media data, and the method of giving the information about a sampling rate is also 
used. 

[0012]Thus, in order to reproduce synchronously two or more media data which synchronizes mutually and should 
be reproduced, a means to coincide the presentation start time of for example, a clock with exact how to progress 
and media data is required. 

[0013]In the situation which this invention tends to solve here, an animation and voice data are reproduced on 
different apparatus. So, in order to satisfy the above-mentioned requirements, it is necessary to take the 
synchronization of time between the clocks of each apparatus, and to arrange about the reproduction start time of 
each media data previously by two sets of apparatus further. 

[0014]First, about the affair of taking the synchronization of time, it is NTP (method for performing time ****** Q f 
computers on Network Time Protocol and the Internet.), for example. It is standardized in the RFC1305 grade of 
IETF. It is realizable by using the matching-the-time method called. Or time information can be sent to receiver 
apparatus from transmitting side apparatus, and it can realize also by setting the clock of receiver apparatus by 
transmitting side apparatus as indicated by JP,2000-332802,A, for example. Although the accuracy of time ****** 
realizable with a method also to everything but these two examples differs, various time bubble ****** are known 
and it is possible to use the arbitrary techniques of these. 

[0015]Next, about the affair of showing and uniting reproduction start time, the following methods are used by this 
embodiment. 

[001 6]In this embodiment, it is the feature to double reproduction start time, without transmitting the information 
about reproduction start time between apparatus. First, the following conditions are established as a precondition. 
The clock of two sets of precondition: and the apparatus 1 1 and 1 4 synchronizes mutually. 

- The transmitting side apparatus 1 1 can control the time S which transmits the first media data to the receiver 
apparatus 1 4 from the transmitting side apparatus 11. 

- An estimate of the maximum of the time required delayMax (processing delay time required for decoding of a 
transit delay and media data, etc. is included) until the received data is reproduced from the media data 
transmission from the transmitting side apparatus 1 1 to the receiver apparatus 14 is possible. 

[001 7]Under the above-mentioned precondition, reproduction start time is synchronized by the method shown 
below. 

How to start reproduction at the time: The transmitting side apparatus 1 1 and the receiver apparatus 1 4 restrict the 
time (reproduction starting reference point) which can reproduction start media data, for example, an animation and 
voice data, to the discrete time set beforehand. The interval of each time is set to Period (= Alpha+delayMax). The 
definition of Period, Alpha, and delayMax is as follows. 
[0018] 

- The interval and Alpha of the maximum estimated value and Period reproduction starting reference point of 
delayMax (transit delay + process delay) the transmitting side (= Period - delayMax) apparatus 1 1 the time S which 
carries out the transmission start of the media data to the receiver apparatus 14. It restricts within the section of 
Alpha after each reproduction starting reference point. That is, by the transmitting side apparatus 1 1 and the 
receiver apparatus 14, processing which defines a reproduction starting reference point at intervals of Period on the 
time-axis which synchronized mutually is performed using the respectively same rule. And transmission of the voice 
data from the transmitting side apparatus 1 1 to the receiver apparatus 1 4 is started within the section of Alpha 
from one of reproduction starting reference points. That is, Alpha serves as the transmission start possible section. 
[0019] Drawing 2 is a system configuration figure of each apparatus shown in drawing 1 . First, the transmitting side 
apparatus 1 1 is explained. The transmitting side apparatus 1 1 like a graphic display, It comprises an animation / 
phonetic memory part 21, the animation / voice separation part 22, the animation decoding part 23, the animation 
temporary storage part 24, the animation display part 25, the send data temporary storage part 26, the voice data 
transmission section 27, the control section 28, the time-of-day-control department 29. and the control data 
transmission and reception section 2A. 



JP,2003-101958,A [DETAILED DESCRIPTION] 



3/6 ^— 



[0020]The video data reproduced by the transmitting side apparatus 1 1 and the voice data reproduced by the 
receiver apparatus 14 are memorized by the animation / phonetic memory part 21. These data is saved in the 
above-mentioned AVI form, and is memorized with information required in order to know the correspondence 
relation between an animation and a sound. Generally, an animation and audio data shall be kept in AVI form, after 
being compressed in a suitable form, also when it was compressed and saved in many cases, and it is this 
embodiment. 

[0021] An animation / voice separation part 22 divides into a video data and voice data the animation/voice data of 
AVI form read from the animation / phonetic memory part 21. The animation decoding part 23 decodes the video 
data of compression format, and changes it into the form which can be displayed in the animation display part 25. It 
memorizes the decoded video data temporarily until it reaches, when the animation temporary storage part 24 is 
displayed. Generally, since the decoding processing of an animation requires time, it becomes possible by performing 
decoding processing beforehand and saving at the animation temporary storage part 24 to display immediately at the 
time of arrival of the time which should be displayed. 

[0022]The animation display part 25 displays the video data memorized by the animation temporary storage part 24 
according to the directions from the control section 28. The send data temporary storage part 26 memorizes voice 
data temporarily until the time when voice data should be transmitted comes. The voice data transmission section 
27 transmits voice data to the receiver apparatus 14 using radio interfaces, such as Bluetooth. 
[0023]The control data transmission and reception section 2 A exchanges control information between the receiver 
apparatus 14 via radio interfaces, such as Bluetooth. The time-of-day-control department 29 minces the time of 
the receiver apparatus 14, and the time which synchronized, and provides the time information used as the standard 
of transmission of moving image reproduction and voice data. The synchronization with the time of the receiver 
apparatus 14 is performed by cooperating with the control section 28 and the control data transmission and 
reception section 2A, and performing match ing-the— time procedures, such as the above-mentioned NTP method. 
[0024]The control section 28 performs cooperation control of the transmitting side apparatus 1 1 whole. The control 
section 28 can be realized as a microcomputer which comprises RAM and a ROM as general-purpose CPU. 
Realization in the form where the operation is made to perform to a microcomputer fundamentally is possible also 
for the functional module mentioned above other than control-section 28. 

[0025]The receiver apparatus 14 comprises voice data receive section 2B, the voice decoding part 2C, voice data 
temporary storage part 2D, the sound reproduction section 2E, the control section 2F, the control data transmission 
and reception section 2G, and the time-of-day-control department 2H like a graphic display. 

[0026]Voice data receive section 2B receives the voice data transmitted from the transmitting side apparatus 1 1. 
The voice decoding part 2C decodes the voice data compressed, and changes it into a refreshable form by the 
sound reproduction section 2E. 

[0027]Voice data temporary storage part 2D is temporarily saved until it reaches at the time which should 
reproduce the decoded voice data. Generally, since voice data is transmitted in the compressed form in many cases 
and requires time for decoding, it becomes possible by decoding beforehand and memorizing to voice data temporary 
storage part 2D to make it pronounce immediately at the time of arrival of regeneration time. 

[0028]The time-of-day-control department 2H minces the time of the transmitting side apparatus 1 1 , and the time 
which synchronized, and provides the time information used as the standard of reproduction of voice data. The 
synchronization with the time of the transmitting side apparatus 1 1 is performed by cooperating with the control 
section 2F and the control data transmission and reception section 2G, and performing matching-the— time 
procedures, such as the transmitting side apparatus 1 1 and the above-mentioned NTP method. The control section 
2F performs cooperation control of the receiver apparatus 14 whole. The control section 2F can be realized as a 
microcomputer which comprises RAM and a ROM as general-purpose CPU. Realization in the form where the 
operation is made to perform to a microcomputer fundamentally is possible also for the functional module mentioned 
above other than control-section 2F. 

[0029]Next, the outline of operation of the system of this embodiment is explained using drawing 3 . The receiver 
apparatus 14 is usually operating by the standby mode, and shifts to the usual operational mode from a standby 
mode in response to the power supply ON directions from the transmitting side apparatus 1 1 . Power consumption is 
in a very low state during standby, and reacting only to power supply ON directions is possible. When a user 
operates the power turn button of the navigational panel 1 2 of the transmitting side apparatus 1 1 , (S38) and power 
supply ON directions (S31) are transmitted to the receiver apparatus 14 from the transmitting side apparatus 11. 
Both apparatus 1 1 and 14 performs channel establishment processing (S32) after the power supply ON. 
[0030]Next, the above-mentioned NTP method etc. perform time bubble ****** (S33). Completion of time ****** 
between the transmitting side apparatus 1 1 and the receiver apparatus 14 will make the preparations for the above- 
mentioned transmission start possible section and reproduction starting reference point being set up by the 
transmitting side apparatus 11 and the receiver apparatus 14, respectively, and performing synchronous 
reproduction. 

[0031]If a user does the depression of the reproduction button of the navigational panel 12 of the transmitting side 
apparatus 11 (S39), by the transmitting side apparatus 11, transmission of voice data and reproduction of a video 
data will be performed. Reproduction of the received voice data is performed by the receiver apparatus 14. These 
operations are performed in accordance with the technique proposed by this invention, in order to take the 
synchronization of an animation and a sound. Although the details of this processing are later mentioned by drawing 
4, fundamentally, it being started only within the transmission start possible section, and transmission of the voice 
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data from the transmitting side apparatus 1 1 to the receiver apparatus 14, the transmitting side apparatus 1 1 and 
the receiver apparatus 14 — reproduction of the video data and voice data which are boiled, respectively and can 
be set will be simultaneously started by being based on the reproduction starting reference point of the beginning 
after the transmission start possible section by which the transmission start was carried out by voice data. 
[0032]lf a user does the depression of the power supply off-button of the navigational panel 1 2 (S40), channel 
cutting and power supply OFF processing will be performed, the receiver apparatus 13 will shift to a waiting state, 
and the transmitting side apparatus 1 1 will be in a power supply OFF state. 

[0033]Next the method of the synchronous reproduction by which it is characterized [ of this embodiment ] using 
drawing 4 is explained. 

[0034]The maximum estimated value of the transmission delay time of data and the time delay of the sum total 
including the processing delay time which decoding processing etc. take is set to delayMax. The value of this 
delayMax is a value decided by measuring beforehand. And the larger value Period than delayMax is defined and a 
reproduction starting reference point is established on a time-axis at intervals of Period. Alpha is determined as 
(Period- delayMax) and let the section of Alpha be the transmission start possible section from said reproduction 
starting reference point By deciding beforehand, these information can coincide the cycle of a reproduction starting 
reference point by both apparatus easily. For example, it is condition of providing Period in 200msec when delayMax 
is 100msec, and making time of the integral multiple of 200msec into a reproduction starting reference point. Since 
matching the time is performed, the time of each reproduction starting reference point is in agreement by both 
apparatus. 

[0035] Here, how to decide transmission start time and reproduction start time for the case of Casel and Case2 in 
drawing 4 by raising to an example is explained. 

[0036]Case1 shows the case where a user pushes a reproduction button, at the time T within the transmission start 
possible section. In this case, transmission of data is started promptly. By a diagram, it has transmitted at the time 
S. If time which becomes refreshable through processing of decoding etc. is set to R after this data reaches the 
receiver apparatus 1 4, the existence range of R will be after the time S from the definition of the above-mentioned 
delayMax, and it will be limited to the range to the reproduction starting reference point which comes first after said 
transmission start possible section progress. If this reproduction starting reference point is set to P0, also in the 
receiver apparatus 14, P0 will become settled uniquely also in the transmitting side apparatus 11. Since transmission 
start time is grasped in the transmitting side apparatus 11, it is obvious, and what is necessary is just to judge the 
refreshable reference point of the beginning after the time R to be P0 from the existence range of R in the receiver 
apparatus 14. In short, after reproduction of received data is attained by the receiver apparatus 14, the first 
reproduction starting reference point is P0. 

[0037]Then, when time PX adding the value Beta beforehand provided in P0 also becomes settled uniquely and 
starts reproduction by both apparatus to time PX, reproduction start time can be coincided. Although zero or more 
values are possible for Beta, when 0 is used, the reaction to a user's reproduction button depression is the quickest. 

[0038]Case2 shows the case where a user pushes a reproduction button, at the time T outside the ready-for— 
sending ability section. In this case, the transmission start of data is kept waiting till the transmission start possible 
section which comes immediately after the time T. Transmission of data is started at the time S with arrival of the 
transmission start possible section. The transmission start of data should just be within this transmission start 
possible section. The existence range of the time R when data becomes refreshable by the receiver 14 is after the 
time S, and is limited to the range to the reproduction starting reference point of the beginning after the 
transmission start possible section progress in which the time S is contained. If this reproduction starting reference 
point is set to P0, also in the receiver apparatus 14, P0 will become settled uniquely also in the transmitting side 
apparatus 11. Since transmission start time is grasped in the transmitting side apparatus 11, it is obvious, and what 
is necessary is just to judge the refreshable reference point of the beginning after the time R to be P0 from the 
existence range of R in the receiver apparatus 14. Then, when time PX adding the value Beta beforehand provided 
in P0 also becomes settled uniquely and starts reproduction by both apparatus to time PX, reproduction start time 
can be coincided. In the case of 0 as well as the case of Casel , the value of Beta has the quickest reaction to a 
user's reproduction button depression. 

[0039]When referred to as Beta=0, the maximum delay from the reproduction button depression of the user in 
Casel to a reproduction start serves as Period, and the maximum delay to a reproduction start serves as 
(delayMax+Period) from the reproduction button depression of the user in Case2. 

[0040]Next, the procedure of the transmitting side apparatus 1 1 at the time of a reproduction start button 
depression is explained using the flow chart of drawing 5 . 

[004 1]A user's push of a reproduction button will start the processing shown in drawing 5 . The present time is 
acquired in Step51. This is performed by asking the time-of-day-control department 29 of the transmitting side 
apparatus 11. Next, it progresses to Step52 and it is judged now whether it is an inside of the transmission start 
possible section. The time-of-day-control department 29 holds the information about the transmission start 
possible section. Here, in being an inside of the transmission start possible section, it progresses to Step53, and 
transmitting processing of voice data is started promptly now. Processing is ended, after progressing to Step54 
succeedingty and starting a moving-image-reproduction preliminary treatment. In a moving-image-reproduction 
preliminary treatment, decoding of the video data compressed is preceded with a display, and is performed, and it 
accumulates in the animation temporary storage part 24. A display is not performed in this stage. The display start 
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to the animation display part 25 is started in the video data reproduction start decision processing mentioned later. 
When judged with the outside of the transmission start possible section by Step52, it progresses to Step55, after 
fixed carries out time standby, it progresses to Step51, and the above-mentioned processing is performed again. 
[0042]Next video data reproduction start decision processing is explained using the flow chart of drawing 6 . 
[0043]This processing is started from Step54 of drawing 5 . First the present time is acquired in Step61. Next it 
progresses to Step62 and it is judged whether it has reached now at the time (PO) which can be reproduction 
started. The time-of-day-control department 29 holds the information about the time (PO) which can be 
reproduction started. Here, when having reached now at the time (PO) which can be reproduction started, it 
progresses to Step63 t and regeneration of a video data is started. When judged with not having reached in Step62 at 
reproduction start time, it progresses to Step64, after fixed carries out time standby, it progresses to Step61, and 
the above-mentioned processing is performed again. In regeneration of the video data started by Step63, it 
reproduces according to the frame rate of the time which the time-of^day-control department 29 minces, and a 
video data. 

[0044]Next, the reproduction start processing of the voice data in the receiver apparatus 14 is explained using 
drawing 7 . This processing is started when the first voice data is received. The present time is acquired in Step71. 
Next, it progresses to Step72 and it is judged whether it has reached now at reproduction start time (PO). When 
having reached at reproduction start time, it progresses to Step73, and regeneration of voice data is started. When 
judged with not having reached in Step72 at reproduction start time, it progresses to Step74, after fixed carries out 
time standby, it progresses to Step71, and the above-mentioned processing is performed again. In regeneration of 
the voice data started by Step73, it reproduces according to the sampling rate of the time which the time-of^day- 
control department 2H minces, and voice data. 

[0045]Thus, even if it does not send the information about transmission start time via a transmission line according 
to this method, it enables the time delay from reproduction instruction to reproduction to start reproduction at most 
(delayMax+Period) and simultaneous. The lip sync (lip sync) can be maintained because the rest regenerates by 
arranging reproduction start timing according to the sampling rate of a video data and each voice data. 
[0046]In the above explanation, although the transmission start of voice data was limited within the transmission 
start possible section, it may replace with this and the transmission start time of the reproduction start command 
for directing a reproduction start from the transmitting side apparatus 11 to the receiver apparatus 14 may be 
limited within the transmission start possible section. That is, when for example, a reproduction start button is 
pushed about voice data, it begins to transmit, and transmission of a reproduction start command is started in the 
first transmission start possible section. It becomes maximum time after delayMax starts transmission of a 
reproduction start command in this case, until the receiver apparatus 14 answers that reproduction start command 
and the start of regeneration of it is attained. This is specified as a maximum estimated value of the transmission 
delay time of a reproduction start command, and the time delay of the sum total including the processing delay time 
which the command interpretation processing takes. It also becomes possible to prepare for the receiver apparatus 
14 the memory storage which memorized voice data in this case. About other points, the completely same method 
as the case where the transmission start timing of voice data is controlled is used. 

[0047]Although the video data was reproduced by the transmitting side apparatus 1 1 and the voice data which 
should be carried out synchronous reproduction to a video data was transmitted to the receiver apparatus 14 from 
the transmitting side apparatus 1 1 in the above-mentioned example. Contrary to this, voice data may be reproduced 
by the transmitting side apparatus 1 1 , and the video data which should be carried out synchronous reproduction to 
voice data may be transmitted to the receiver apparatus 14 from the transmitting side apparatus 1 1. An example of 
this reproducing system is shown in drawing 8 . 

[0048]In the system of drawing 8 . the portable audio player 101, It has the memory storage with which the voice 
data which accompanies a video data and it is recorded, and reproduce voice data, and it outputs from the earphone 
103, and a video data is transmitted to the displays 102, such as portable LCD, via a radio channel. 
[0049]The synchronous reproduction method of this embodiment can be applied, when reproducing two video datas 
which need to carry out synchronous reproduction by two different apparatus, or also when reproducing two voice 
data which need to carry out synchronous reproduction by two different apparatus. An example of the system which 
carries out synchronous reproduction of the two voice data by two different apparatus is shown in drawing 9 . 
[0050]The system of drawing 9 is a viewing system which used DVD player 201, and the video data reproduced by 
DVD player 201 is displayed on the monitor 203 of TV etc. The voice data of the multiple channel outputted from 
DVD player 201 is sent to the audio amplifier 202^ Reproduce the voice data of the main L and R channel, and it 
reproduces from the front speaker 204,205 of L and R, and the audio amplifier 202 transmits L for surround, and the 
voice data of R channel to the back loudspeaker system 206,207 of L and R via a radio channel etc. By applying the 
method of this embodiment to the audio amplifier 202 and the back loudspeaker system 206,207, respectively, the 
synchronous reproduction of voice data is easily realizable. 

[0051]Since all the functions of the transmitting side apparatus used by the synchronous reproduction method of 
this embodiment and each receiver apparatus are realizable by a computer program. Only by introducing the 
computer program into the usual computer, and executing it through the storage with which the computer program 
was memorized and in which computer reading is possible, the same effect as this embodiment can be acquired 
easily. 

[0052]this invention is not limited to the above-mentioned embodiment and in the range which does not deviate 
from the gist, many things are boiled and it can be changed at an execution phase For example. Period does not 
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always need to be constant, and as long as rt excels rather than delayMax, it may be made to change it by the 
pattern decided beforehand. The value of Alpha does not need to be constant, either and it may be made to make it 
similarly change by the pattern decided beforehand. It becomes possible [ the value of delayMax ] to use variable by 
preparing the structure etc. which optimize the value of delayMax according to communication environment. 
[0053]The invention of various stages is included in the above-mentioned embodiment, and various inventions may 
be extracted by the proper combination in two or more constituent features indicated. For example, even if some 
constituent features are deleted from all the constituent features shown in an embodiment, the technical problem 
described in the column of Object of the Invention is solvable, and when the effect described in the column of the 
effect of the invention is acquired, the composition from which these constituent features were deleted may be 
extracted as an invention. 
[0054] 

[Effect of the Invention]lt becomes possible to reproduce synchronously by apparatus which is different in the 
information which synchronized mutually like an animation and the sound which accompanies it. without transmitting 
the information about regeneration time according to this invention, as explained above. 
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Cktf-Pti. Beta(iOW±©{i^RlfigTfeS^ OlC 

[0 0 3 8] 035628, Wt&l1&5SM1\M*1A'T 
1f*«ff4#*>*ifTLfc*^**LTV^. £<Dig£ 30 
(i, r-*<02lfiBI«itt«fSiJT©ia»»ciiJ*r«2lflllll! 
teRTfigglB! S T'ift $ ft 5. 3£<IBfl% RTflgEMOSI* £ 

fit 1 4 T-x-*#S£Rrtt£&3B#2!j R <D#ftf&Wi. 

m\ s mai s &%£ftzmmmi£zim%.r&im 
<Dn£.mtemm&* p 0 t*s t?o umtrnmst 1 1 
mpj^tgi 1 icis^-c\tm@ffi!&m\itiEmLTi>%rz 40 

fcfM^o ^C-e, POlC^&^&fcffiBetafcjtomLfcIlf 
mi P X 0 » «*J P X KiS^O««TH4* 

#T*#3 0 Beta<0{I«Casel«0^i:|5l^ OO^lC 

[0 0 3 9] £43, Beta=0 t CaselO 

jI$£(iPeriod£&^ Case2<D^-&cDrL-+f(^S4^^ 50 
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>i?Tfr 6 S£&BJ£ $ T'©«*Mi (del ayHax+Per i o 
[0 0 4 0] &\m5(D7a-?v-h*m^T, ff£ 

mb$*>frfvs<DmMmwsk 1 1 Qimzmztsmt 

[00 4 1] a— WS«t«jry%JfrtB5Kifft 

a^sift^ft^o step5iT*a^so^j^^-r^ 0 c 

KHtClB-rSlf«8«fS!lfr8SP2 9*<«fiplxTl/''*. d 

§itiE#ste P 54{cji*, mnn&mwmzgMLrc 

^zmwT-*<Dm^itm7r^MTLTm\ wm-m 

\<\ ®wwm2 5^<owmmi., sBs-raftiSr- 
2n$iMmi7Z.9m<D$x*mi2ftz 0 step52r*2i«M 

&^fitEF^tt£Wg£ftfci§£«Step55tii#, K£© 
HfM«F«Lfc*H:Step51^3i*, fflg, fl&iSOfflJIfcfl 

[0 0 4 2] ^lcSI6<D7n-^-v-h^:ffl^r, KB 

[0 0 4 3] C©J!ia{i@5<OStep54*>e>et!l$ft5o 
S*\ Step61T?tt£ft©ll**J£ffiff-r*o &£Step62»C 
Jt*» 31ft, S^ra^Rltl^J (P0) ICMLT^Zfr 
SfrfcWJTTS. S4BB»RTI!l«f9J (PO) fcWrsfl! 
««l^9J«l!»29^fi!fiFbT^*o CCTf, SfiE. 
S&mmmi (PO) tiSLrv>S*&ttStep63^Jt 

»iBf f -*©ll*«yi*fi»'r*. Step62-PS^I» 
jl&BtS'JfCjg LTV^^ i:|iJ^^ftfc^-&8Step64'\3t 

BE€OI«IBI«f«Lfc»Step61'\Jt*, WM<D 

T?tt, BM8lVltf2 9 0»f$g!lfcS)iIix-*<D71x- 

[0 0 4 4] *|C» 0 7^ffll/^T§€iJ^§§l 4k:fe»t 

atiP^ff, ga©^r-^^§fiL/cB#{c^^ft 
5 0 Step71T-ti31ft(7)Btmj^^#-r§ 0 ^tCStep72tCJi 

*, m£.mtem$i (po) tatrv^s^ws 

•T5„ H4IB!lfil^EiJK:aLT^S*&ttStep73'Njft*, 

«o«ia«f«Lfc»step7i'\3i*, se, mi6oftyi* 

Step73T*gl&^ftfc^7 r -^OS^5!lliT'{i. 
[0 0 4 5] iioi^tc, *^r^cj:fttfjM®lflm^J 



(8) 

13 

e.ff £ £ X'(Di®mmtm4 (del ayMax+Per iod) T\ 
ft?£t T\ U y~7i/y? (1 ip sync) ££o UttfT* 

[0 0 4 6] a±©^T*«, %j£7 : -?<nmm 

t« lfre>£fHU$§§l 4KttbTlf£F>8 

j£T?2S«b»«>T*i#, ff£l?g&n v> « 
WOSimP5S5IteErai?MJi&-r5o C<D»^ de 

layMaxti, KO&flSrllfl&LTfr^fg 
fflij«|g§ 1 4 Tb^cDS^te^vy Ktc^LTS^a 

-**Etibfct2Sgfi*£€{ll$g§l 4(cfflMLT4o 

mm® z f ^ y 9*.mmt zm-s t £ < m vxmttm ^ 

[0 0 4 7] $fc, ±ie©0miS)Bx-*£3M€lJ« 
ill n?S4U tif-^t^Si-r^ff^f- 
**aHSfll«S 1 1 l 4 lc2HILfc*\ 

lfr6*fcfillt»l 4tCjM{gtTta^o COH^X 30 
[0 0 4 8] H8«5">Xfi»ttt, r-C*r 

L-f-t i o i a, ifiax-^tJitf^nic^fii-rs^ 

-**S£bT^*yi 0 3*^ffi^-r§i:^c, si 
L C Dft 2©*jj*«H 1 0 2 fc»i«aflK&*rt'bT 

[0049] ztc. ^mmmmcommn^mit, mm 
$>mm°if&x2bZo 2~D<DgpT-2%2~D<Dg%;%m 

[0 0 5 0] 09<Dv'X-xA«, DVD7Wt20 1 
^ffl^fttlK.~>XxAT*^"9, DVD/Wt2 0 1 1C 
J:oT?l£SnS»liBT-*ttTVfc£©*r:*2 0 3 
fcS^SttSo £rcDVD-fl"< J r2 0 1 A^HJ^^tl 

*«Rf-y*;l/©*^r-*H:*— T4*Tyf2 o 2 

!CiiS6tlS. *-f-ft7y72 0 2l^^>(DL, R 
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-ii20 4, 2 0 5frt>m£irzt&K. •v^'yyvm 

<DL, R^+*;l/©^x-*£&tl£lffifi8&&££rt-b 
TL, R©/^y^Xlf-*v'7 t xA2 0 6, 2 0 7 fcg 
flf*. *— r-r*7>:/2 0 2i:/^7.tr-;*r>7 > 

fA206, 207 t*n^n*ms*i8o*tt*affl 

[005 1] !^ *IQfi««0|q|IIHfl^ffiT?«ffl"r 

sasfl«i«»te«ktf*fliiii««*n j eti©«ffi«-r'<T 

* fu y=? h*mn<D 3 > \L a - * ICS a t TUtT-r & 

[0052] *fc. *nwn. ±.mnffiBMicmmzti 
mT-m*\cmmtzcttfvjmT>&z 0 fl&*.tfPeriodH: 

Hfc— £?fc.5£®i&< , delayMaxi 9 tfittftff. 
*ftft*&n;fc/<*->T?£{fc<3f#S*?K:bT«>fc 
l\ ratKlC, AlphaO<it-^T'fe5'2>S(i*<, 
fta&ftfc/<*->"eSf{fcS-£SJ:$fc:bTfcfiv\, $ 
fc, del ayMax©«*affi««K-&fc-eT*affcT 5 ttfi 

[0 0 5 3] ±!3iaS»»tt4a'«r©aBO»W 

tf, HSfi«18k:^*ns^K!^ilft*^»-3^<D«filSI 
#*<9JI»*nTt, 5SW^»i*bJ:3 fc-rS8WH<0*T 

[0 0 5 4] 

tf*a-r«*^oj:dfcsvtcra»ibfciis«*a4*« 

[0®<Dffim«:UiB«] 

[02] H*w»«o?i4'>xf-A*«ii«-r«aie«i« 

[03] HH«««©ll4S«'Xf 1 AO»^*^-rH. 
[0 4] raHSfi«IBOII4S/^f-A»ci3tt«RJBII4«i 

[0 5] H*«#80«£->Xr AtcfcttSS&Wii&jK 
[06] raHJfiJgffiOHS^Xf-Atfe^SnUBfliaig 
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"ho 

[07] mmmmm^m^iy^^asif^mmm^ 

"he 

[08] *fBfiO-«»JBI8K:«*S4S/^f-AO«!© 

[09] *f»fiO-*«»IB»C«*S4S/^rA©«& 
tffi©«|fig<0-PJ*^-rrP -y *0 O 

i l — jMUHMOI 

1 2-tWfc**Jl/ 
1 3-ilR 

1 4-3MMM8 

2 i -na/ffmns 
2 2-»a/s^»iia5 
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Period 
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T W£<K*>*TFfc*!i 

R Mff<D*J« 5*- * flrgj* u pj(t t * o AfcflJ 

P0 Mttgfl 
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period n±ns«ds%jA0>nm 
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